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Abstract — The covariance evolution is a system of differential 
equations with respect to the covariance of the number of edges 
connecting to the nodes of each residual degree. Solving the 
covariance evolution, we can derive distributions of the number 
of check nodes of residual degree 1, which helps us to estimate 
the block error probability for finite-length LDPC code. Amraoui 
et al. resorted to numerical computations to solve the covariance 
evolution. In this paper, we give the analytical solution of the 
covariance evolution. 

I. Introduction 

Gallager invented low-density parity-check (LDPC) codes 
H) in 1963. LDPC codes are linear codes defined by sparse 
bipartite graphs. Luby et al. introduced the peeling algorithm 
(PA) 12, flU for the binary erasure channel (BEC). PA is an 
iterative algorithm which is defined on Tanner graphs. PA and 
brief propagation (BP) decoder have the same decoding result. 
As PA proceeds, edges and nodes are progressively removed. 
The residual graphs consist of nodes and edges that are still 
unknown at each iteration. The decoding successfully halts if 
the graph vanishes. 

Amraoui showed that distributions of the number of 
check nodes of degree one in the residual graph convergences 
weakly to a Gaussian as blocklength tends to infinity. Amraoui 
also showed that block and bit error probability of finite-length 
LDPC codes are derived by the average and the variance of 
the number of check nodes of degree one in the residual 
graph. The average number of check nodes of degree one in 
the residual graph is determined from a system of differential 
equations, which was derived and solved by Luby et al. 0. 
The variance of the number of check nodes of degree one 
in the residual graph is also determined from a system of 
differential equations called covariance evolution, which was 
derived by Amraoui et al. [3|. Since analytical solution of 
covariance evolution has not been known so far, we had 
to resort to numerical computations to solve the covariance 
evolution. 

An alternative way to determine the variance of the number 
of check nodes of degree one was proposed in 0. The 
variance of the number of check nodes of degree one in the 
residual graph can be computed by determining the variance 
of the number of erased messages of BP for BEC with 
parameter e* where e* is the threshold of the ensemble under 
BP decoding. This method is a valid approximation for the 
erasure probability close to e*. Moreover, Ezri et al. extended 
to this method to more general channels 0. However, if we 



solve the covariance evolution analytically, we can derive the 
variance of the number of check nodes of degree one in the 
residual graph for all e where e is the channel parameter for 
the BEC. 

In this paper, we show an analytical solution of the covari- 
ance evolution for regular LDPC code ensembles. 

II. Covariance Evolution 

In this section, we briefly review the covariance evolution 
and initial covariance in 0. 

We consider the transmission over the BEC with channel 
erasure probability e using LDPC codes in a (6, cf)-regular 
LDPC code ensemble. Let t denote the iteration round and £ 
be the total number of edges in the original graph. We define 
that 

r-f 0) 

Define a parameter y such that dy/dr = — l/{ey l ) and 
y = 1 when r = 0. Let 4,t denote a random variable 
corresponding to the number of edges connecting to variable 
nodes of degree b in the residual graph at the iteration round t. 
Let rfe t denote a random variable corresponding to the number 
of edges connecting to check nodes of degree k in the residual 
graph at the iteration round t. Those random variables depends 
on the choice of the graph from (b, d)-regular LDPC code 
ensemble, the channel outputs and the random choices made 
by PA. We define 

T>t ■= {h,t, ri )t , r 2 ,t, • ■ ■ , r d -x,t}- 

To simplify the notation, we drop the subscript t. For i 6 T> t , 
we define i(y) by 
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We also define flW) (y) by the covariance of i and j (i, j G T> t ) 
divided by the total number of edges in the original graph i.e. 

In 0, Amraoui showed these parameters satisfy the following 
system of differential equations in the limit of the block length. 



This system is referred to as covariance evolution 

dS^(y) e(y) 
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x := 1 — x, e := 1 — e, e(y) = lb = 



x(y - 1 + x 6 * x ) and 



is the indicator function which equals to 1 if fc = s and 
otherwise. 

The initial conditions of the covariance evolution are given 
by initial covariances. The initial covariances are the covari- 
ances of the number of edges of each degree at the start of the 
decoding divided by the total number of edges in the original 
graph. For j, k £ {1,2,..., d}, initial covariances are derived 
in J3), as follows. 

5^(1) = -&^-jW-^e- j), 
5^ k )(i ) = I{k= . }j (d-J^ e i~ e <i-3 



+ (P-1) 



1 



1 



A+k-\~2d-i-k-\ 



J -lj\k- 1, 

■(de-j)(de-k). 

III. Analytical Solution of Covariance Evolution 

We show in the following theorem the analytical solution 
of the covariance evolution, for a (b,d) -regular LDPC code 
ensemble. The proof is given in Section UlTCI 

1 Taking the derivative of both sides of ^3), @ and {3) with respect to y, 
we can check that those equations fulfill (2)- 



Theorem 1. Let r be the normalized iteration round of PA as 
defined in ([T). For a ( b, d) -regular LDPC code ensemble and 
j,k e {1, 2, . . . , d — 1}, in the limit of the code length, we 
obtain the following. 

5 (h,h) = 6eg; (3) 
6 {h,ri) = - Gj {ee(b - l)y~ l + ex} + I {j=1} bei, (4) 
6 (rk ^ = ^GkG^b - l)y- 2 - (e - e)xy- 1 + x 2 } 
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b 
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+ I {k=3} I 7 : I kx k x d k + I {k=1J=1} {bee 
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k3 - 1, 
'd-l s 

- {l{k=i}G 3 + I {j=1} G k ){ee(b - I)?," 1 - ex + x 2 }, (5) 

where Gj := (^x^x^'-^dx - j) + I {j=1} and y is 
defined by dy/dr = — l/(ey b ~ 1 ) with y = 1 when r = 0. 

A. scaling parameter a 

In [3 1, scaling parameter a is given by 



(6) 



3e I e*;y* 

where e* is the threshold of the ensemble under BP decoding , 
y* is the non-zero solution of fi(y) at the threshold , n is the 
blocklength and £ is the total number of edges in the original 
graph. 

We define x* :— e*(y*) b ~ 1 and x* := 1 - x*. Since 
fx(e*,y*) = Oand f^| e - ;r = 0, we see that y* = l-(i*) d - 1 
and y* = (6— l)(e? — l)x*(x*) d ~ 2 . Using those equations, we 
have from (0 



<5 (ri ' ri) (e*,?;*) = 



xV 



(Note that Gi = 
x d_1 ). We see that 

dfi | 

From ©, we can obtain 



T y*). Recall that ri(e,y) = x(y - 1 



x*y* 
>(6-l) 




This is the same result as in {3) for regular LDPC code 
ensembles. 

B. Example of Solution of Covariance Evolution 

Figure \T\ shows the solution of the covariance evolution 
§( r i< r i>(e,y), j G {1,2, .. . ,5}, as a function of y for (3,6)- 
regular LDPC code ensemble. Figure [2] shows the solution 
of the covariance evolution 5^ ri,rj \e,y), j £ {1,2,3}, as a 
function of y for (2,4)-regular LDPC code ensemble. 

C. Outline of proof 

1) Proof for S^"- tb \- From ©, we get dA " ( ^' b> (y) = 0. 
From initial covariance, we have S ^ ' l '" lb ' , — bee. This leads to 
©. 




Fig. 1. The solution of the covariance evolution 5v"J > r i\ j g {1, 2, . . . , 5}, 
as a function of the parameter y for the (3,6)-regular LDPC code ensemble. 
The channel parameter is e = 0.4294398 ~ e*. 
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Fig. 2. The solution of the covariance evolution g( r 3' r 3i, j £ {1, 2, 3}, as 
a function of the parameter y for the (2,4)-regular LDPC code ensemble. The 
channel parameter is e = 0.333333 ~ e*. 



2) Proof for S^ b ' rj \- In order to solve S^ b ' rj \ we de- 
fine AV>»^ ._ YfelSton), which gives dA<lb - J:) - 



2~2j=i dS d y 3 ■ F rom ©> we see that 



dy 



dy 
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where 



D<- lb ^ := dix^y- 1 - l)5 (ld ' ld) . 



This equation is a first order linear differential equation and 
the solution is given by 



A (h,z) = y d(b 



_ 1} r f (b-l)D^ 



y 



d(6 _i )+ i -<iy + c h ,x} 

= G d ee{b - l)?," 1 + bee + Ci^y^^, 

with a constant Ci b .s determined from the initial covariance 
where G d := ( d Zl)x j - 1 x d - j - 1 (dx - j) + / {j= i } . Note that 



^(*i,,£)(l) = Y J %l^ h ' ri) {'\) = be~e-bde d ~e. We see that 
C/ b s = -de d e. We have 



A (h,n = Gd {( 6 _ ^eey- 1 + ex} + bee. 
From (O and (|8), we get for j G {1, . . . , d — 1} 



(8) 



dy 



where 



D (h,r,) ~j{ H±L ^ bee -5^-^ I 
h 

+ (A^ -be~e)I {j=d _ l} }. 



0¥d-i} 



Those equations are first order linear differential equations. 
The solutions are given by 



2f 



with constants C; 6iI . determined from the initial covariances. 
Those equations can be solved by mathmatical induction for 
j G {2,3,...,d-l}. 

We show that S ( - lb ' Td - 1 ^ fulfill ©. From <[8j>, we can write 

D (h,r d -i) =(d-l)exG d 

+ eey- l {bG d -i + (b - l)(d - l)G d }. 
Using the same way in the induction step, we can obtain 

g(.h,u-i) = _G d -i{(6 - Vjeey- 1 + ex}. 

We show that if 5(^.^+0 fulfill ©, then also 5<^> r j) fulfill 
© . Assume = -G j+ i{ee(b - 1) + ex}. Using the 

induction hypothesis, we can write 

= jexG j+1 + eiy-^bGj + (b - l)jG 3+1 }. (9) 
Using x k — 57Js=o (s)( — a; ) S ' we see that 



= - ixGj 
Similarly, we have 

,J(b-l) 



(b - l)jexG j+ i 



y 



j(b-l)+l 



d-1 

d - j - 1 \J - 1 

(6 - ^eey-^Gj 



(10) 
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_ 1} ( (b-lfe~ey-^G 3+ 
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where 



K. := 



Note that 



a(6-l)-l 



s (& - 1) - 1 h^b-l)^!} + lp g = ■ 



{«(& - 1) - &}Jf a _i = 



{(«-l)(6-l)=l}- 



From (fTTb and ( fT2b . we have 



,j(b-l) + l 



dy 



- (6 - l)ee 



_/d- 1 



i-i 



E 



d- 



(.7 + s){s(6 - 1) - 6}if s 



= - (6 - l)eey- 1 G j + (b - l)eex 3 Pj 



(13) 



where 



Pa ■= 



d-3 



From ([9t.(fT0t and ( fl3t . we have 

=-G j {(b-l)eey- l +ex}+ '' ' "' ~ ' 



d - i - 1 Vi - 1 

+ (6-l)e^'P i + a 6 , r .^ 6 - 1 ). 
From initial covariance, we have 

Hence we obtain 

§{h,ri) = -G s {(b - Vjeey' 1 + ex}. 

This lads to @ for j 6 {2, 3, . . . , d - 1}. 

Note that (5^' ri > = A 1 - 1 "'^ -J^jZl <5 (ib,r,) and that -G x = 

S j=2 ^7 ■ ^ e ^ aVe 

jC^n) = _Gi{(6 - l^ej/ -1 + ere} + bee. 

Hence we obtain (0). 

3) Proof for B^'^h In order to solve <$( r V' r *') , we define 

B (r„E) . = S ( rj .r k ) and B (E,E) . = £^1 flfo.E), From 

©, we get for j £ {1, 2, . . . , d - 1} 

(W ' 1 '^ ''-\( D W+2dBW), (14) 



dy y 
dB^^ _b-l 
dy y 



{D^^ + (d + j)B^^}, (15) 



where 



lb lb 

-jB^^I {3 ^ 1} 

+ (d-l)( B W-dr d -A^)I {j=d _ 1} . 



The solution of ( TBI is given by 

S (E,S) =y 2d(b-l)( /"(5_1) 



' y2rf(6-l) + l 



6-1 



G2{ e g(6-l)y- 2 -( e -e) a; y- 1 } 
+ 2G d {(6-l)e«T 1 +e~ a; } 

with a constant Cj^e which determined from the inital covari- 
ance. From the initial covariance, we get 

B (s ' s) (1) = bee - 2bde d i + de d - de 2d + {b - l)d 2 e 2d ~ l e. 

We see that Ce,e = ^-d 2 e 2d — de 2d . Hence we have 

B W J-^±G 2 {(b - l)e~ey- 2 - (e - e)xy^ + x 2 } 

+ 2G d {(b-l)eiy- 1 + ex} 

+ dx d - dx 2d + be~e. (16) 

From ( fTBT ). we get 

a -y \j y ( d +Mb-i)+i a y + u ^^p 

with constants C r ;> e- For j € {2, 3, . . . , d— 1}, those equation 
are solved by mathmatical induction as the proof for S^ lt " rj \ 
From the initial covariances, note that 

5^(1) = d(b - 1) ^ ~ ^ e d+ i- l ~e d -i{de - j) 

+ d(^Z e d +^^ - bft ~_ ^ ^"'(de - j). 

We have 

S (r - S) = - ^G d G,{(6 - l)e«T 2 - (e - eQzy" 1 + x 2 } 



G,{(6-l)eey- 1 + ex} 



C-"0 



dx d+j x d - j . 

(17) 



Using S^i^) = #( s > s ) - J2 j= 2 , we have 



6-1 



G d G!{(6 - l)eey- 2 - (e - e)^" 1 + x 2 } 



Gi{(6 - l)eey _1 + ex} + dx 



d+l-d-l 



+ G d {{b ~ Vjeiy- 1 + ex} + dx d i + bei. (18) 

4) Proof for S^ Tk ' rj \- From d2), we get for k,j £ 
{l,2,...,d-l} 

dS ( - r "' r ^ 6-1 



where 



-{(k+j)S irk ^ ) +D^ rk ' r ^}, 



H; 



k n + l-rk s (l b<rj) _ kS (r h+ll r j ) I 
lb 

-(d-l)(S«»>^ -B^^)I {k=d _ l} . 



The solutions of those differential equations are given by 



II 



(k+j){b-l) 



(b-l)D( r »< r ^ 



y{k+j)(b- 

with constants C rfc . r . Using ( fTTT i. we can solve those equa- 
tions by mathmatical induction for j,k e {2, 3, . . . , d — 1}. 
We have 

<5 (r *' ri) = ^G fc G J {ee~(6 - l)y- 2 - (e - e)^" 1 + x 2 } 

-<i:l)C=0^^' 



d-l 

3-1 



jx 3 x 3 . 



Note that S^"^ = S^ 2 ) - Y^Zl 8 (rk ' rj) - We have for 
fee {2,..., 

=^G fe Gi{ee(6 - 1)jT 2 - (e - e^y" 1 + x 2 } 

-GkHb-^eey- 1 -ex + x 2 }. 
Since J^i) = S^i.s) - J^Z^ 5< ri ' r J\ we have 

=^-G\{ee{b - 1)jT 2 - (e - e)^ 1 + x 2 } 
-^ 2 x 2d - 2 + xx d - 1 

- 2Gi{(fe - l)eey" 1 - ex + x 2 } + {bee - xx). 
Thus, we can obtain (0. 

IV. Relationship To Stability Condition 

In this section, we consider the relationship between the 
stability condition JSJ, (4J and Ymiy^Q5^ l '" ri \e,y). 

For a (&, d)-regular LDPC code ensemble (b > 3), we see 
from © and (HJl that 

limS^(e,y) = beU {j=l} , 

y^Q 

limS^' r ^(e,y) = beil {j=1} . 

For a (2, d)-regular LDPC code ensemble, we see from (0]i 
and © that 



2ee{l - (d - l)e}, if j = 1 

if 3 = 2 
otherwise, 



limtf('».'-i)(e > y) = { 2ee(d-l)e 
\imS ir ^ rk \e,y) 

y^O 

'2ei{l -(d- l)e} 2 , if j = k= 1 

2e 2 e(d-l){l-(d-l)e}, if (j, fc) = (1,2), (2,1) 
2ei(d- l) 2 e 2 , if j = k = 2 

0, otherwise. 
If we define the correlation coefficient for i, j £ 2? by 



Pi,i( e ) : = lir n 




Fig. 3. Solution of covariance evolution lim^^o <5( J,ri '(e, y), j G 
{^2i f*2}, as a function of the channel parameter e for the (2,4)-regular 
LDPC code ensemble. 



we obtain 



1, 



if L 



{b=2 



l)e < 1 



-1, if 7 {6=2} (d-l)e>l. 



(19) 



Note that I{b=2} {d— l)e < 1 agree with the stability condition 
for regular LDPC code ensembles. 

Figure [3] shows the solution of covariance evolution 
lmiy-to 5^' ri '{e, y), j £ {h, T\, r2}, as a function of the chan- 
nel parameter e for the (2,4)-regular LDPC code ensemble. 
From Figure[3] we see that S^ 2 ^ 1 ^ > and 5^ l2 ' ri ' > when 
(d - l)e < 1. Also we see that S^ 2 ' 1 ' 1 '' < and S^ 2 ^ < 
when (d - l)e > 1. 

V. Conclusion and Future Work 

In this paper, we have solved analytically the covariance 
evolution for regular LDPC code ensembles. Moreover we 
have derived the relationship between stability condition. 

As a future work, we will derive an analytical solution of 
the covariance evolution for irregular LDPC code ensembles. 
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y-o ^<J(M)(e,y)<5(w)(e,y)' 



